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(54) Environment-compliant image display system and information storage medium 



(57) To provide an environment-compliant image 
display system and information storage medium, the 
system is provided with an environmental correction 
processing section for correcting an LUT in a 3D-LUT 



storage section, thus correcting colors, and a 7 correc- 
tion section for correcting y values in a 1 D-LUT storage 
section, thus correcting brightness, based on environ- 
mental information that has been measured by a color- 
ed-light sensor. 
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Description 

[0001] Japanese Patent Application No. 
2000-230950, filed on July 31 , 2000, is hereby incorpo- 
rated by reference in its entirety 

Field of the Invention 

[0002] The present invention relates to an environ- 
ment-compliant image display system and information 
storage medium. 

Background of the Invention 

[0003] When displaying images at a plurality of differ- 
ent locations (in presentations, meetings, medical treat- 
ments, the design and fashion field, business activities, 
education, as well as general-purpose images such as 
those in movies, TV, video, and games), an important 
part of achieving effective presentations is to make it 
possible to reproduce images exactly as the creator of 
those images intended, whatever the location. 
[0004] One way of considering how to adjust the view- 
ing of such images is management of the input-output 
characteristics of the device to achieve color manage- 
ment in the reproduction of colors. Specific methods of 
how to achieve this are not, however, clear. 
[0005] When projecting and displaying an image with 
a projector and screen, in particular, it is difficult to re- 
produce colors in a suitable manner without considering 
not only ambient light but also the screen type. 
[0006] Recent advances in increasing resolution of 
projectors have made color reproducibility important as 
well. 

[0007] In a prior-art projector, a one-dimensional look- 
up table (1 D-LUT) is used with the objective of providing 
refinements such as color temperature adjustment, y 
correction, and correction of the characteristics of the 
display elements. 

[0008] To achieve high-quality color management, 
however, it is necessary to aim for consistency of repro- 
ducible color gamut between other display devices hav- 
ing different reproducible color gamuts and a standard 
color space (sRGB, for example). 
[0009] It is also necessary to match the reproducible 
color gamut of a display device that has been affected 
by its environment with the reproducible color gamut of 
other display devices or the standard color space. To 
achieve such matching of the reproducible color gamut, 
corrections called color compression and color expan- 
sion are applied. 

[0010] When it comes to matching two reproducible 
color gamuts, a part of one reproducible color gamut 
projects from the other reproducible color gamut, and 
another part of the one reproducible color gamut is with- 
in the range of the other reproducible color gamut. For 
that reason, it is necessary to perform corrections that 
apply compression to a specific color range or expan- 



sion to another specific color range, within the same re- 
producible color gamut. 

[0011] It is difficult to implement such color control 
over specific range by using ID-LUTs to control the gam- 
s ma values of each RGB color. Even though a 1 D-LUT 
is a mapping table, it can only control primary colors and 
it is difficult to apply different levels of control for each 
color. 



[0012] The present invention was devised in the light 
of the above-described technical problem and has as 
an objective thereof the provision of an environment- 
is compliant image display system and information stor- 
age medium that make it possible to reproduce substan- 
tially the same colors rapidly at a plurality of different 
locations. 



20 (1 ) In order to solve the above described technical 
problem, a first aspect of the present invention re- 
lates to an environment-compliant image display 
system which corrects an image based on environ- 
mental information expressing a visual environment. 

25 in an area in which the image is displayed, and dis- 
plays the image, the environment-compliant image 
display system comprising: 

means for storing brightness correction infor- 
30 mation for correcting brightness of the image, 

based on the environmental information, and 
color correction information for correcting color 
of the image, based on the environmental infor- 
mation; and 

35 correction means for correcting image informa- 

tion for displaying the image, based on the en- 
vironmental information, the brightness correc- 
tion information, and the color correction infor- 
mation. 

40 

(2) A second aspect of the present invention relates 
to an information storage medium including a pro- 
gram which corrects an image based on environ- 
mental information expressing a visual environment 
45 jn an area in which the image is displayed, and dis- 
plays the image, the information storage medium 
comprising a program for a computer to realize: 

means for a predetermined storage area to 
50 store brightness correction information for cor- 

recting brightness of the image, based on the 
environmental information, and color correction 
information for correcting color of the image, 
based on the environmental information; and 
55 correction means for correcting image informa- 

tion for displaying the image, based on the en- 
vironmental information, the brightness correc- 
tion information, and the color correction infor- 
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mation. 

These aspects of the present invention make it 
possibl&itp adjust brightness and color in a more 
flexible'ffianner, by separating brightness correc- s 
tion information and color correction information for 
management, while correcting an image by using 
environmental information. 

In the prior art, a one-dimensional look-up table 
(1 D-LUT) is used with the objective of providing re- 10 
finements such as color temperature adjustment, y 
correction, and correction of the characteristics of 
the display elements, by way of example. 

To achieve high-quality color management, 
however, it is necessary to aim for consistency of 15 
reproducible color gamut between other display de- 
vices having different reproducible color gamuts 
and a standard color space (sRGB, for example). 

It is also necessary to match the reproducible 
color gamut of a display device that has been af- 20 
fected by its environment with the reproducible 
color gamut of other display devices or the standard 
color space. To achieve such matching of the repro- 
ducible color gamut, corrections called color com- 
pression and color expansion are applied. ^ 

When it comes to matching two reproducible 
color gamuts, a part of one reproducible color gam- 
ut projects from the other reproducible color gamut, 
and another part of the one reproducible color gam- 
ut is within the range of the other reproducible color 30 
gamut. For that reason, it is necessary to perform 
corrections that apply compression to a specific 
color range or expansion to another specific color 
range, within the same reproducible color gamut. 

It is difficult to implementsuch colorcontrol over 35 
specific range by using 1 D-LUTs to control the gam- 
ma values of each RGB color. Even though a 
1 D-LUT is a mapping table, it can only control pri- 
mary colors and it is difficult to apply different levels 
of control for each color. On the other hand, a three- 40 
dimensional look-up table (3D-LUT) makes it pos- 
sible to control each color, even if they are not pri- 
mary colors, which enables variable control (color 
compression and color expansion) for each range 
of color such as those described above. 45 

The use of a 3D-LUT makes it possible to con- 
trol features such as variable color compression 
and color expansion for each range of color, which 
is difficult with a 1 D-LUT, thus enabling accurate 
color reproduction. 50 

In this manner, it is possible to achieve suitable 
color reproduction by managing a 1 D-LUT for 
brightness correction independently of a 3D-LUT 
for color correction. 

This makes it possible to absorb differences be- 55 
tween display environments and thus display the 
same image regardless of the environment to which 
it is applied. It is therefore possible to reproduce 



substantially the same colors in a plurality of differ- 
ent locations, within a short time. 

Note that "visual environment" in this case re- 
fers to factors such as ambient light (such as artifi- 
cial light, natural light) and the object on which the 
image is displayed (such as display device, wail sur- 
face, screen). 

This environmental information could be values 
that indicate color and brightness, such as xyY, or 
color and brightness correction amounts, such as 

When implementing such an image display 
system, it is possible to do so by using means such 
as a projector or monitor. 

(3) In this image display system and information 
storage medium, the brightness correction informa- 
tion may comprise a one-dimensional look-up table, 
and the color correction information may comprise 
a three-dimensional look-up table. 

Similarly, the one-dimensional look-up table 
may comprise at least one of a gamma table and a 
color balance table, and the three-dimensional 
look-up table may comprise at least one of a color 
gamut correction table and a color temperature cor- 
rection table. 

(4) In this image display system and information 
storage medium, the correction means may com- 
prise means for collecting a plurality of types of en- 
vironmental information that is input thereto all to- 
gether, and may correct the image information 
based on the collected environmental information. 

Even when a plurality of types of environmental 
information is input, this ensures that subsequent 
correction processing can be performed rapidly by 
collecting these types. 

In such a case, information in a form such as 
xyY, Luv, Lab, or XYZ can be used as the informa- 
tion after the collection. 

(5) In this image display system and information 
storage medium, the correction means may modify 
a predetermined correction coefficient that is used 
in a correction of the image information, based on 
the environmental information. 

This makes it possible to reproduce colors in a 
manner to suit the actual visual environment, by tak- 
ing default correction coefficients that have been 
set by the manufacturer and varying them in accord- 
ance with target colors, by way of example. 

(6) This image display system may comprise visual 
environment detection means for measuring at 
least one of the color value, gamma, and color tem- 
perature of an image that is displayed in the image- 
displayed area. 



3 



BNSDOCID: <EP 1 1 78680A2_I_> 



5 



EP 1 178 680 A2 



6 



(7) In this information storage medium, the environ- 
mental information may be information from a visual 
environment detection means for measuring at 
least one of the color value, gamma,;and color tem- 
perature of an image that is displayed in the image- 
displayed area. 

Note that this visual environment detection 
means could be one or a combination of several dif- 
ferent devices, such as a luminance sensor that 
measures the luminance value of the image-dis- 
played area, a colored-light sensor that measures 
the RGB values or XYZ values of the image-dis- 
played area, or a chromaticity sensor that measures 
the chromaticity values of the image-displayed ar- 
ea. 

In this case, "color values" refers to indices that 
express colors by factors such as tri-stimulus val- 
ues., chromaticity coordinates, spectrum distribu- 
tion; excitation purity, or main wavelength. 

(8) In this image display system and information 
storage medium, the image-displayed area may be 
an area on a screen. 

[0013] This image display system can be applied in a 
satisfactory manner even when the way in which colors 
are seen is greatly changed by materials such as the 
screen. 

[0014] This image display system may comprise: 

means for displaying an image that guides to input 
a type of the screen; and 

means for inputting the input type of the screen as 
at least part of the environmental information. 

[0015] This information storage medium may com- 
prise a program for a computer to realize: 

means for a display means to display an image that 
guides to input a type of the screen; and 
means for an input means to input the input type of 
the screen as at least part of the environmental in- 
formation. 

[0016] This makes it possible to correct the colors and 
brightness of an image in a suitable manner, by deter- 
mining the visual environment of the screen in a manner 
that cannot be considered in the prior art. 
[0017] In particular, since there is only a small number 
of screen types and people can easily distinguish be- 
tween them, there is little likelihood of a decision error 
during input of this screen type and thus it is possible to 
determine the screen type accurately. 
[0018] Note that this screen could be of a reflective 
type or a transparent type. 

[0019] The visual environment detection means may 
determine the visual environment with reference to the 
screen type. 



[0020] This visual environment detection means 
could comprise a sensor that determines the screen 
characteristics, by way of example. 
[0021] More specifically, the screen characteristics 
5 could be determined by using a sensor such as a color- 
ed-light sensor to measure reflected light (passed light) 
when a white light is projected. 

[0022] This makes it possible to determine the visual 
environment in light of the screen type, and also absorb 

10 differences in screen type by applying correction such 
as gamma correction or color temperature correction 
that is based on the result of this determination. It is thus 
possible to reproduce the same image with colors that 
are independent of the screen type. 

is [0023] With PCs orthe like that use operating systems 
with internal prior-art color management systems, in 
particular, the only consideration is the type of display 
connected to the PC. In addition, methods of performing 
color correction from consideration of ambient light have 

20 been proposed, but there is nothing that considers the 
screen that forms the area in which the image is dis- 
played. 

[0024] The present invention makes it possible to cre- 
ate and display images that reflect the visual environ- 
25 ment in a suitable manner, by applying color correction 
after determining the visual environment with reference 
to the screen type. 

[0025] In this image display system, the visual envi- 
ronment detection means could also comprise means 
30 for determining the visual environment by measuring at 
least ambient light. 

[0026] Similarly, the information storage medium 
could also ensure that the visual environment detection 
means determines the visual environment by measuring 

35 at least ambient light. 

[0027] This makes it possible to determine the visual 
environment by a method such as measuring the ambi- 
ent light. Ambient light within the visual environment has 
a huge effect on the way in which an image is seen. The 

40 visual environment can be determined in a suitable 
manner by measuring the ambient light which is a major 
factor in how an image is seen. 

BRIEF DESCRIPTION OF THE DRAWINGS 

45 

[0028] 

Fig. 1 is a schematic illustrative view of a presenta- 
tion system that uses a laser pointer in accordance 
so with an example of this embodiment of the present 
invention; 

Fig. 2 is a functional block diagram of the image 
processing section within a prior-art projector; 
Fig. 3 is a functional block diagram of the image 
55 processing section within a projector in accordance 
with an example of this embodiment of the present 
invention; and 

Fig. 4 shows an example of the method of deriving 
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the chromaticity correction coefficients 5 when Y = 
Y1. 

DETAILED DESCRIPTION 

[0029] The description below relates to a case in 
which the present invention is applied to an image dis- 
play system which uses a liquid-crystal projector and 
which can adapt to the environment, by way of example, 
with reference to the accompanying figures. 

Description of Overall System 

[0030] A schematic illustrative view shown in Fig. 1 is 
of a presentation system that makes use of a laser point- 
er 50, in accordance with an example of this embodi- 
ment of the present invention. 

[0031] A projector 20 that is provided substantially 
facing a screen 10 projects an image for a predeter- 
mined presentation. A presenter 30 gives a presentation 
to an audience, while using a light spot 70 projected from 
the laser pointer 50 to point at a desired position of an 
image in an image display region 12, which is a image- 
displayed area on the screen. 

[0032] During such a presentation, the way in which 
images on the image display region 1 2 are seen will vary 
greatly, depending on factors such as the type of the 
screen 10 and ambient light 80. When the same white 
is displayed, for example, it could seem to be white with 
a yellow cast or white with a blue cast, depending on the 
type of the screen 1 0. Even when the same white is dis- 
played, it could seem to be a bright white or a dull white 
if the ambient light 80 differs. 

[0033] Recently, the projector 20 has become smaller 
and easy to transport. For that reason, it has become 
possible to perform presentations at a client's location, 
by way of example, but it is difficult to adjust colors to 
match the environment at the client's location and the 
manual adjustment of colors at the client's location takes 
too much time. 

[0034] A functional block diagram of the image 
processing section within a prior-art projector is shown 
in Fig. 2. 

[0035] This prior-art projector inputs an R1 signal, a 
G1 signal, and a B1 signal (which for RGB signals in 
analog format, sent from a PC or the like) to an A/D con- 
version section 110, and uses a projector image 
processing section 100 to perform color modification on 
an R2 signal, a G2 signal, and a B2 signal which have 
been converted into digital form by the A/D conversion 
section 110. 

[0036] A D/A conversion section 1 80 converts an R3 
signal, a G3 signal, and a B3 signal, which have been 
subjected to the color modification of the projector im- 
age processing section 100, into analog form and out- 
puts them as an R4 signal, a G4 signal, and a B4 signal. 
A light valve (L/V) drive section 1 90 drives liquid-crystal 
light bulbs to display an image, based on the R4 signal 



G4 signal, and B4 signal. 

[0037] The projector image processing section 100, 
which is controlled by a CPU 200, comprises a projector 
color conversion section 120 and a profile management 
5 section 130. 

[0038] The projector color conversion section 120 
converts the RGB digital signals (the R2 signal, G2 sig- 
nal, and B2 signal) into RGB digital signals for projector 
output (the R3 signal, G3 signal, and B3 signal), based 
on a projector input-output profile that is managed by 
the profile management section 130. Note that "profile" 
in this case refers to characteristic data. 
[0039] In this manner, the prior-art projector can only 
perform color modification based on an input-output pro- 
file that indicates input-output characteristics that are 
specific to that particular projector, so no consideration 
is paid to the visual environment in which the image is 
projected and displayed. 

[0040] However, it is difficult to make the way in which 
colors are seen uniform in this manner, without taking 
the visual environment into account. The way in which 
colors are seen is determined by three factors: light, the 
reflection or transmission of light by objects, and vision. 
[0041] This embodiment of the present invention im- 
plements an image display system that can reproduce 
an image with the same visual appearance, by deter- 
mining the visual environment of light and the reflection 
or transmission of light by objects, irrespective of the 
environment in which it is applied. 
[0042] More specifically, the device is provided with a 
colored-light sensor 417 that functions as visual envi- 
ronment detection means for determining the visual en- 
vironment, as shown in Fig. 1 , and environmental infor- 
mation from the colored-light sensor 41 7 is input to the 
projector 20. To be more specific, the colored-light sen- 
sor 41 7 measures colored-light information (more spe- 
cifically, information indicating xyY colors and bright- 
ness) of the image display region 12 within the screen 
10. 

[0043] The projector 20 is provided with color control 
processing means that stores and manages brightness 
correction information, for correcting the brightness of 
the image based on this environmental information, and 
color correction information, for correcting the colors of 
the image based on this environmental information, and 
correction means that corrects the image information for 
displaying the image, based on the environmental infor- 
mation, the brightness correction information, and the 
color correction information. 

[0044] The description now turns to the function 
blocks of the image processing section of the projector 
20, which comprises this color control processing 
means and this correction means. 
[0045] A functional block diagram of the image 
processing section within the projector20 in accordance 
with an example of this embodiment of the invention is 
shown in Fig. 3. 

[0046] The image processing section comprises an 



15 



20 



25 



30 



35 



40 



45 



50 



5 



BNSDCCID: <EP 1 178680 A2_l_> 



9 



EP1 178 680 A2 



10 



input signal processing section 401 to which RGB sig- 
nals are input, a color control processing section 420, a 
calibration section 430 that functions as correction 
means, an output signal processing section 405, and an 
LA/ drive section 406. 

[0047] The input signal processing section 401 com- 
prises an A/D conversion section 440 that converts the 
R1 , G1 , and B1 analog image signals into the R2, G2, 
and B2 digital image signals. 

[0048] The color control processing section 420 com- 
prises a one-dimensional look-up table (1D-LUT) 402 
for input signal processing, a three-dimensional look-up 
table (3D-LUT) storage section 403 that is used in cor- 
recting the color information, and a 1 D-LUT storage sec- 
tion 404 that is used in correcting the brightness infor- 
mation. 

[0049] Note that a gamma table and color balance ta- 
ble (or just one of them) are stored as part of the bright- 
ness correction information in the 1 D-LUT storage sec- 
tions 402 and 404. Similarly, a color gamut correction 
table and a color temperature correction table (or just 
one of them) are stored as part of the color correction 
information in the3D-LUT storage section 403. 
[0050] In the art, color control is done with a 1 D-LUT 
and brightness correction is done by determining what 
potential is used when sampling the input signal. 
[0051] During the correction of the brightness of 
colors to be reproduced, it is necessary to boost the out- 
put of lower-range grayscale. In this case, brightness 
correction is performed by a 1 D-LUT that can manipu- 
late a grayscale characteristic. 

[0052] As previously described, color correction is 
done with a 3D-LUT, to ensure appropriate color com- 
pression or color expansion for each color when it 
comes to matching other reproducible color gamuts by 
color control. 

[0053] In this manner, brightness and color can be 
corrected separately, based on environmental informa- 
tion relating to brightness and environmental informa- 
tion relating to color, making it possible to perform each 
type of correction more precisely. 
[0054] The description now turns to color correction, 
which will be followed by a description of brightness cor- 
rection. 

Color Correction 

[0055] The calibration section 430 comprises a cali- 
bration image presentation section 407 which inputs im- 
age signals for calibration (correction) to the input signal 
processing section 401 , a color conversion section 408 
which converts colors for conversion (stored in the 
3D-LUT storage section 403) from the RGB color sys- 
tem into the XYZ color system, and an environmental 
correction processing section 41 0 which performs color 
and brightness correction, based on environmental in- 
formation that is input from the colored-light sensor 41 7. 
[0056] Note that the RGB system results in device- 



dependent colors that vary with the input-output device, 
such as a projector, but the XYZ system results in non- 
device-dependent colors. 

[0057] The calibration section 430 comprises a Gam- 
5 ut information management section 412 and a chroma- 

ticity correction coefficient processing section 411 . 

[0058] The Gamut information management section 

412 manages the color gamut information of the image 

to be depicted. The color gamut information is supplied 
10 to the chromaticity correction coefficient processing 

section 411 and used in the derivation of chromaticity 

correction coefficients 5. 

[0059] The chromaticity correction coefficient 
processing section 411 draws a plurality of similarly- 

'5 shaped triangles of the reproducible color gamut, based 
on the RGB colors from the Gamut information manage- 
ment section 412. The chromaticity correction coeffi- 
cient processing section 411 derives chromaticity cor- 
rection coefficients (such as 5 (x1,y1 , Y1)) that are 

20 based on color information (such as x1,y1 ,Y1) from the 
environmental correction processing section 410. 
[0060] An example of the method of deriving the chro- 
maticity correction coefficients 5 when Y = Y1 is shown 
in Fig. 4. 

25 [0061] When RGBW (where W means white (or gray)) 
color triangles are drawn on an xy chromaticity chart, 
the result is as shown in Fig. 4, by way of example. 
[0062] The chromaticity correction coefficient 
processing section 411 assumes that the chromaticity 

30 correction coefficient for the color of the range between 
the outermost triangle and the one within it (the center 
triangle) is 5 = m Similarly it assumes that the chro- 
maticity correction coefficient for the color of the range 
between the center triangle and the innermost triangular 

35 is 5 = n In this case, m and n are coefficients. It also 
assumes that the chromaticity correction coefficient for 
the color of the range within the innermost triangle is 5 

[0063] Thus the chromaticity correction coefficient 
40 processing section 411 obtains chromaticity correction 
coefficients ( 5 (x1 , y1 , Y1 )) relating to the color informa- 
tion (x1 t y1, Y1) that is input from the input signal 
processing section 401 , and outputs those chromaticity 
correction coefficients to the environmental correction 
45 processing section 410. 

[0064] It is therefore possible to reproduce colors suit- 
ably (perform color correction), by modifying the chro- 
maticity correction coefficients in accordance with the 
input colors. 

so [0065] The environmental correction processing sec- 
tion 41 0 also inputs environmental information from the 
colored-light sensor 41 7. 

[0066] The colored-light sensor 417 functions as a 
visual environment detection means that determines the 
55 visual environment. The colored-light sensor 41 7 could 
be one or a combination of several different devices, 
such as a luminance sensor that measures the lumi- 
nance value of the image-displayed area, a colored-light 
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sensor that measures the RGB values or XYZ values of 
the image-displayed area, or a chromaticity sensor that 
measures the chromaticity values of the image-dis- 
played area. 

[0067] In other words, the environmental correction 
processing section 410 could also input a plurality of 
items of environmental information from the colored- 
light sensor 41 7. In such a case, the environmental cor- 
rection processing section 410 would have to perform 
weighting in accordance with the input environmental in- 
formation (such as weighting of luminance, color tem- 
perature, and color information). 
[0068] To reduce the processing load due to such 
weighting, the environmental correction processing sec- 
tion 410 is provided with an environmental information 
collecting section 450 that collects a plurality of items of 
environmental information all together. 
[0069] The environmental information collecting sec- 
tion 450 performs predetermined processing on a plu- 
rality of items of environmental information to obtain a 
single of environmental information. 
[0070] Since it is possible to express color tempera- 
ture and correlated color temperature in chromaticity co- 
ordinates (x, y), these can be collected as xyX. 
[0071] The following equations can be applied as a 
more specific example of the collection for a single item 
of environmental information, by way of example. 

A x = a 1 x 1 + a 2 x 2 + - • + a p x p 

A y = a iVi + a 2 v 2 + ' " + a q v q 
A y = b 1 Y 1 + b 2 Y 2 + ». + b r Y r 

[0072] In this case, a and b are the previously de- 
scribed weighting coefficients. In this manner, weighting 
can be done in a collected manner to derive coordinated 
correction requests A x , Ay, and A Y that are necessary 
for correcting for various environmental influences. The 
subsequent circuitry can perform the necessary correc- 
tions in a simple manner, by using A x , A yj and A Y - Note 
that A x , Ay, and A Y in this case are derived from a com- 
parison with environmental information for an ideal 
state. 

[0073] The environmental correction processing sec- 
tion 410 performs color correction by using the color in- 
formation (A x , Ay) from within the collected environmen- 
tal information. 

[0074] More specifically, the environmental correction 
processing section 410 performs the processing de- 
scribed below upon color information (such as X1 , Y1 , 
and Z1 ) from a 3D-LUT storage section 409, in order to 
overwrite corresponding colors of the 3D-LUT storage 
section 403. 

[0075] First of all, the environmental correction 



processing section 410 performs the following calcula- 
tions to obtain chromaticity coordinates (x1 , y1): 

' i 

soec. ' 

x1 =X1 /(X1 +Y1 +21) 



y1 = Y1 /(X1 + Y1 +Z1) 

10 [0076] The environmental correction processing sec- 
tion 410 then outputs color information (x1 , y1, Y1) to 
the chromaticity correction coefficient processing sec- 
tion 411 and inputs chromaticity correction information 
(6 (x1 , y1 , Y1)) from the chromaticity correction coeffi- 

15 cient processing section 411 . 

[0077] The environmental correction processing sec- 
tion 41 0 obtains chromaticity (x2, y2) based on environ- 
mental information (A x , A y ), chromatic correction infor- 
mation ( 8 ) that has been collected by the environmen- 

20 tal information collecting section 450, and chromaticity 
(x1 ,y1 ). More specifically, following equations could be 
used for the conversion, by way of example: 

25 x2 = Kx(x1, A x , 6) 



y2 = Ky(y1, A y , 5) 

30 

z2 = 1 - x2 - y2 



X'1 =x2(X1 + Y1 + Z1) 

35 

Y'1 =y2(X1 +Y1 +Z1) 



40 Z'1 = z2(X1 + Y1 + Z1) 

[0078] The environmental correction processing sec- 
tion 410 outputs the thus-obtained tri-stimulus values 
(X'1 , Y'1 , Z'1 ) to a post-correction 3D-LUT storage sec- 
45 tion 414. 

[0079] The color conversion section 408 converts the 
(X'1 , Y'1 , Z'1) values in the post-correction 3D-LUT stor- 
age section 414 into (R'1 , G'1, B'1) values, then outputs 
the converted (R'1 , G'1 , B'1) values to the 3D-LUTstor- 
50 age section 403. 

[0080] In the 3D-LUT storage section 403 : the colors 
at the mapping destination of the 3D-LUT are overwrit- 
ten by using (R'1, G'1, and B'1). 

[0081] In this manner, it is possible to reproduce 
55 colors to suit the visual environment, by overwriting the 
colors of the 3D-LUT in the 3D-LUT storage section 403, 
based on the visual environment. 
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Brightness Correction 

[0082] The description now turns to brightness cor- 
rection. 

[0083] This brightness correction is mainly done by 
correcting the 7 values in each 1 D-LUT stored in the 
1 D-LUT storage section 402 and the 1 D-LUT storage 
section 404, by 7 correction section 41 3. 
[0084] The 7 correction parameter A Y that was ob- 
tained by the environmental correction processing sec- 
tion 41 0, using the above described method, is input by 
the environmental correction processing section 410 to 
the 7 correction section 413. 

[0085] The 7 correction section 41 3 performs 7Correc- 
tion processing based on Ay from the environmental cor- 
rection processing section 410, to convert 7 1 of the 
1 D-LUT storage section 402 into 7V and 72 of the 
1 D-LUT storage section 404 into 72 1 . 
[0086] In this manner, it is possible to reproduce 
brightness to suit the visual environment, by overwriting 
the 1D-LUTs of the 1 D-LUT storage sections 402 and 
404, based on the visual environment. 
[0087] The output signal processing section 405 in- 
puts image signals (R5, G5, and B5) that have been ad- 
justed by using the look-up tables (LUTs) that have been 
subjected to brightness correction by the 1 D-LUT stor- 
age sections 402 and 404 and color correction by the 
3 D-LUT storage section 403. 

[0088] The output signal processing section 405 uses 
a D/A conversion section 441 to convert the digital im- 
age signals (R5, G5, and B5) into analog image signals 
(R6, G6, and B6), then outputs the converted analog im- 
age signals to the L/V drive section 406. 
[0089] The LA/ drive section 406 uses those analog 
image signals to drive liquid-crystal light bulbs to regu- 
late the image projected from the projector 20. 
[0090] In this above described manner, the way in 
which the image is seen in the image display region 12 
of the screen 1 0 can be adjusted as appropriate by ad- 
justing the image projected by the projector 20. 
[0091] This embodiment of the present invention 
therefore ensures that the projector 20 takes the visual 
environment into consideration when projecting and dis- 
playing an image. 

[0092] This makes it possible for the projector 20 to 
absorb differences between display environments and 
thus display the same image regardless of the environ- 
ment in which it is used. This embodiment of the present 
invention therefore enables the reproduction of substan- 
tially the same colors within a short time, in a plurality 
of different locations. 

[0093] The projector 20 can also boost the output of 
lower- range grayscale and correct the brightness of the 
reproduced colors by using a 1 D-LUT that enables ma- 
nipulation of the grayscale characteristic during the 
brightness correction. 

[0094] The projector 20 can also apply color compres- 
sion and color expansion independently for each color, 



by using a 3D-LUT for the color correction. 
[0095] In this manner, the projector 20 can apply 
brightness correction and color correction separately, 
based on environmental information relating to bright- 
5 ness and environmental information relating to color, 
thus enabling it to apply both types of correction more 
precisely. 

Description of Hardware 

10 

[0096] Note that the various means described below 
could be applied as hardware to be used in the previ- 
ously described components. 

[0097] For example, the input signal processing sec- 
*5 tion 401 could be implemented by using an A/D convert- 
er or the like, the color control processing section 420 
could be implemented by using RAM or a CPU or the 
like, the output signal processing section 405 could be 
implemented by using a D/A converter or the like, the U 
V drive section 406 could be implemented by using a 
liquid-crystal light bulb driver or the like, and the calibra- 
tion section 430 could be implemented by using an im- 
age processing circuit or the like. Note that these com- 
ponents could be implemented by hardware such as cir- 
cuitry, or by software such as drivers. 
[0098] The functions of these components could also 
be implemented by the reading of information from an 
information storage medium 500. Means such as a 
CD-ROM, DVD-ROM, ROM, RAM, or hard disk can be 
used as the information storage medium 500, and either 
a direct method or an indirect method could be used for 
reading that information. 

[0099] Instead of the information storage medium 
500, it is also possible to implement the above described 
functions by downloading a program for implementing 
those functions from a host device or the like, through 
a transfer path. In other words, a program or the like for 
implementing the above described functions could be 
embodied over carrier waves. 

[0100] The present invention has been described 
above by way of an ideal embodiment thereof but the 
application of the present invention is not limited to that 
embodiment. 



[0101] The LUTs stored in the previously described 
1 D-LUT storage sections 402 and 404 could provide val- 
ues that are scattered, such as in a mapping table form, 
so or they could provide continuous values, such as those 
derived from functions. 

[0102] Note that if values are in a dispersed form, 
such as in a mapping table, substantially continuous val- 
ues (corresponding colors) can be obtained by interpo- 
55 lation using a method such as Lagrange interpolation or 
linear interpolation. 

[01 03] In the embodiment of the present invention de- 
scribed above, the colored-light sensor 417 was used 
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as the visual environment detection means by way of 
example, but an input means that inputs at least some 
part of the environmental information (such as the pres- 
ence/absence of external light, the illumination type, or 
the screen type) or an image display means that dis- 
plays an image for prompting the input of such details 
could be used therefor. Both the colored-light sensor 
417 and means for displaying a screentype input image 
for acquiring information such as the screen type could 
be used together as the visual environment detection 
means. 

[0104] With a screen, in particular, it is easy for people 
to distinguish the type of the screen easily, so it is pos- 
sible to use the above described image display means 
to show choices for selecting the screen type, thus mak- 
ing it possible to reproduce colors with accurate consid- 
eration of the screen type. 

[0105] In this case, the visual environment deter- 
mined by the visual environment detection means ap- 
plies to factors such as ambient light (such as artificial 
light or natural light) and the object on which the image 
is displayed (such as a display, wall surface, or screen). 
[0106] In particular, this embodiment of the present 
invention makes it possible to apply more appropriate 
image correction by obtaining information on a compo- 
nent that is not much considered in the prior art (i.e., the 
screen), thus enabling the reproduction of more uniform 
image colors. 

[0107] Note that the screen 1 0 described above is of 
a reflective type, but it could equally well be of a trans- 
parent type. If the screen is of a transparent type, a sen- 
sor that scans the screen directly could be used as the 
colored-light sensor. 

[0108] Similarly, the present invention can also be ap- 
plied to presentations done by displaying images by a 
display means other than a projection means such as 
the previously described projector. Other than a liquid- 
crystal projector, a projector using a digital micromirror 
device (DMD), a cathode ray tube (CRT), a plasma dis- 
play panel (PDP), a field emission display (FED) device, 
an electroluminescence (EL) device, or a direct-vision 
type of liquid crystal display device could be used as 
such a display means. Note that DMD is a trademark 
registered to Texas Instruments Inc. of the USA. 
[01 09] It should be obvious that the present invention 
would also be effective when displaying images in ap- 
plications that are not presentations, such as in meet- 
ings, for medical treatment, in the design or fashion 
world, in business activities, and in education, as well 
as for general-purpose image displays such as movies, 
TV, video, and games. 

[01 10] In some cases, the A/D conversion section 440 
is not necessary when the input signal (R1 , G1 . B1) is 
in digital form, and the D/A conversion section is also 
not necessary when the output signal (R6, G6, B6) is 
digital form. This can be done as necessary in accord- 
ance with the input devices and output devices that are 
used. 



[0111] Note that the functions of the previously de- 
scribed image processing section of the projector 20 
could be implemented by a simple image display device 
(such as the projector 20), or they could be implemented 
s by being distributed between a plurality of processing 
devices (such as processing that is distributed between 
the projector 20 and a PC). 

[0112] In above embodiment, information in xyY (or 
Yxy)formis used as color information comprising bright- 

10 ness information, but it could equally well be in another 
format such as Lab : Luv, or LCh. 
[0113] The above described environmental informa- 
tion could also be values that express color and bright- 
ness in a form such as xyY, but it could also be color 

is and brightness correction amounts in a form such as 

[0114] In addition, the embodiment described above 
related to application to a front-projection type of projec- 
tor, but the present invention can equally well be applied 
20 to a rear-projection type of projector. 



Claims 

25 1. An environment-compliant image display system 
which corrects an image based on environmental 
information expressing a visual environment in an 
area in which the image is displayed, and displays 
the image, the environment-compliant image dis- 
30 play system comprising: 

means for storing brightness correction infor- 
mation for correcting brightness of the image, 
based on the environmental information, and 
35 color correction information for correcting color 

of the image, based on the environmental infor- 
mation; and 

correction means for correcting image informa- 
tion for displaying the image, based on the en- 
40 vironmental information, the brightness correc- 

tion information, and the color correction infor- 
mation. 

2. The environment-compliant image display system 
45 as defined by claim 1 , 

wherein the brightness correction information 
comprises a one-dimensional look-up table, 
and 

50 wherein the color correction information com- 

prises a three-dimensional look-up table. 

3. The environment-compliant image display system 
as defined by claim 2, 

55 

wherein the one-dimensional look-up table 
comprises at least one of a gamma table and a 
color balance table, and 
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wherein the three-dimensional look-up table 
comprises at least one of a color gamut correc- 
tion table and a color temperature correction ta- 
ble. 

4. The environment-compliant image display system 
as defined by any one of claims 1 to 3, 

wherein the correction means comprises 
means for collecting a plurality of types of environ- 
mental information that is input thereto all together, 
and corrects the image information based on the 
collected environmental information. 

5. The environment-compliant image display system 
as defined by any one of claims 1 to 4, 

wherein the correction means modifies a pre- 
determined correction coefficient that is used in a 
correction of the image information, based on the 
environmental information. 



information expressing a visual environment in an 
area in which the image is displayed, and displays 
the image, the information storage medium com- 
prising a program for a computer to realize: 

means for a predetermined storage area to 
store brightness correction information for cor- 
recting brightness of the image, based on the 
environmental information, and color correction 
information for correcting color of the image, 
based on the environmental information; and 
correction means for correcting image informa- 
tion for displaying the image, based on the en- 



vironmental information, the brightness correc- 
tion information, and the color correction infor- 
mation. 

5 10. The information storage medium as defined by 
claim 9, 

wherein the brightness correction information 
comprises a one-dimensional look-up table, 
io and 

wherein the color correction information com- 
prises a three-dimensional look-up table. 

11. The information storage medium as defined by 
*5 claim 10, 

wherein the one-dimensional look-up table 
comprises at least one of a gamma table and a 
color balance table, and 

wherein the three-dimensional look-up table 
comprises at least one of a color gamut correc- 
tion table and a colortemperature correction ta- 
ble. 

12. The information storage medium as defined by any 
one of claims 9 to 11 , 

wherein the correction means comprises 
means for collecting a plurality of types of environ- 
mental information that is input thereto all together, 
and corrects the image information based on the 
collected environmental information. 

13. The information storage medium as defined by any 
one of claims 9 to 12, 

wherein the correction means modifies a pre- 
determined correction coefficient that is used in a 
correction of the image information, based on the 
environmental information. 

14. The information storage medium as defined by any 
one of claims 9 to 13, 

wherein the environmental information is in- 
formation from visual environment detection means 
for measuring at least one of the color value, gam- 
ma, and color temperature of an image that is dis- 
played in the image-displayed area. 

15. The information storage medium as defined by any 
one of claims 9 to 14, 

wherein the image-displayed area is an area 
on a screen. 

16. The information storage medium including a pro- 
gram as defined by claim 15; for a computer to re- 

55 alize: 

means for a display means to display an image 
that guides to input a type of the screen; and 



20 

6. The environment-compliant image display system 
as defined by any one of claims 1 to 5. further com- 
prising: 

visual environment detection means for meas- 25 
uring at least one of the color value, gamma, 
and color temperature of an image that is dis- 
played in the image-displayed area. 

7. The environment-compliant image display system 30 
as defined by any one of claims 1 to 6 t 

wherein the image-displayed area is an area 
on a screen. 

8. The environment-compliant image display system 35 
as defined by claim 7, further comprising: 

means for displaying an image that guides to 
input a type of the screen; and 
means for inputting the input type of the screen 40 
as at least part of the environmental informa- 
tion. 

9. An information storage medium including a program 
which corrects an image based on environmental *5 
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means for an input means to input the input type 
of the screen as at least part of the environmen- 
tal information. 
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